Technical Note—A Markov Chain Partitioning Algorithm for Computing Steady State Probabilities
نویسندگان
چکیده
منابع مشابه
Complexity of Embedded Chain Algorithm for Computing steady State Probabilities of Markov Chain
The paper presents the theoretical evaluation of the complexity of an algorithm, based on embedded Markov chains, for computing steady state probabilities. Experimental research with different infinitesimal generator matrices was performed to support theoretical evaluations. Results showed that modified algorithm can be more effective for sparse matrices. An example of a queuing system is prese...
متن کاملanalysis of ruin probability for insurance companies using markov chain
در این پایان نامه نشان داده ایم که چگونه می توان مدل ریسک بیمه ای اسپیرر اندرسون را به کمک زنجیره های مارکوف تعریف کرد. سپس به کمک روش های آنالیز ماتریسی احتمال برشکستگی ، میزان مازاد در هنگام برشکستگی و میزان کسری بودجه در زمان وقوع برشکستگی را محاسبه کرده ایم. هدف ما در این پایان نامه بسیار محاسباتی و کاربردی تر از روش های است که در گذشته برای محاسبه این احتمال ارائه شده است. در ابتدا ما نشا...
15 صفحه اولReviving the Two-state Markov Chain Approach (Technical Report)
Probabilistic Boolean networks (PBNs) is a well-established computational framework for modelling biological systems. The steady-state dynamics of PBNs is of crucial importance in the study of such systems. However, for large PBNs, which often arise in systems biology, obtaining the steady-state distribution poses a significant challenge. In fact, statistical methods for steady-state approximat...
متن کاملAsymptotics for Steady-state Tail Probabilities in Structured Markov Queueing Models
In this paper we establish asymptotics for the basic steady-state distributions in a large class of single-server queues. We consider the waiting time, the workload (virtual waiting time) and the steady-state queue lengths at an arbitrary time, just before an arrival and just after a departure. We start by establishing asymptotics for steady-state distributions of Markov chains of M/GI/1 type. ...
متن کاملExtended Viterbi Algorithm for Hidden Markov Process: A Transient/Steady Probabilities Approach
In this paper an extended Viterbi algorithm is presented for first-order hidden Markov processes, with the help of a dummy combined state sequence. For this, the Markov switching’s transient probabilities and steady probabilities are studied separately. The algorithm gives a maximum likelihood estimate for the state sequence of a hidden Markov process. Comparing with the standard Viterbi algori...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Operations Research
سال: 1985
ISSN: 0030-364X,1526-5463
DOI: 10.1287/opre.33.1.228